Nonparametric Estimation via Convex Programming

نویسندگان

  • Anatoli Juditsky
  • Arkadi Nemirovski
چکیده

In the paper, we focus primarily on the problem of recovering a linear form g x of unknown “signal” x known to belong to a given convex compact set X ⊂ R from N independent realizations of a random variable ι taking values in a finite set, the distribution p of ι being affinely parameterized by x: p = Ax + b. With no additional assumptions on X and A, we develop minimax optimal, within an absolute constant factor, and computationally efficient estimation routine. We then apply this routine to recovering x itself in the Euclidean norm.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Linear and Second Order Cone Programming Approaches to Statistical Estimation Problems

Estimation problems in statistics can often be formulated as nonlinear optimization problems where the approximating function is also constrained to satisfy certain shape constraints. For example, it may be required that the approximating function be nonnegative, nondecreasing or nonincreasing in some variables, unimodal in a variable, convex, or concave. We show how these shape constraints can...

متن کامل

Estimation of Nonparametric Conditional Moment Models with Possibly Nonsmooth Moments

This paper studies nonparametric estimation of conditional moment models in which the residual functions could be nonsmooth with respect to the unknown functions of endogenous variables. It is a problem of nonparametric nonlinear instrumental variables (IV) estimation, and a difficult nonlinear ill-posed inverse problem with an unknown operator. We first propose a penalized sieve minimum distan...

متن کامل

Shape Constrained Density Estimation via Penalized Rényi Divergence

Abstract. Shape constraints play an increasingly prominent role in nonparametric function estimation. While considerable recent attention has been focused on log concavity as a regularizing device in nonparametric density estimation, weaker forms of concavity constraints encompassing larger classes of densities have received less attention but offer some additional flexibility. Heavier tail beh...

متن کامل

Constrained Nonparametric Estin1ation via rvIixtures

\Ve a approach to measures constrained to lie in a convex set. \Ve measures as mixtures known extreme measures, and so the of eS1Jlnlal;lng a constrained measure becomes one of estimating an unconstrained mlXmeasure. constraints arise in many such as estimation of the mean estimation under stochastic constraints. Vve describe mixture representation techniques for these and other and to maximum ...

متن کامل

Nonparametric bivariate copula estimation based on shape-restricted support vector regression

Copula has become a standard tool in describing dependent relations between random variables. This paper proposes a nonparametric bivariate copula estimation method based on shape-restricted -support vector regression ( -SVR). This method explicitly supplements the classical -SVR with constraints related to three shape restrictions: grounded, marginal and 2-increasing, which are the necessary a...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2007